Potential-based Credit Assignment for Cooperative RL-based Testing of Autonomous Vehicles

While autonomous vehicles (AVs) may perform remarkably well in generic real-life cases, their irrational action in some unforeseen cases leads to critical safety concerns. This paper introduces the concept of collaborative reinforcement learning (RL) to generate challenging test cases for AV planning and decision-making module. One of the critical challenges for collaborative RL is the credit assignment problem, where a proper assignment of rewards to multiple agents interacting in the traffic scenario, considering all parameters and timing, turns out to be non-trivial. In order to address this challenge, we propose a novel potential-based reward-shaping approach inspired by counterfactual analysis for solving the credit-assignment problem. The evaluation in a simulated environment demonstrates the superiority of our proposed approach against other methods using local and global rewards.Comment: Accepted at IJCNN'2

A user preference perception model using data mining on a Web-based Environment

In a competitive environment, how to provide the information and products to meet the requirements of customers and improve the customer satisfaction will be the key criteria to measure a company’s competitiveness. Customer Relationship Management (CRM) becomes an important issue in any business market gradually. Using information technology, businesses can achieve their requirements for one to one marketing more efficiently with lower cost, labor and time. In this paper, we proposed a user preference perception model by using data mining technology on a web-based environment. First, the users’ web browse records are aggregated. Second, fuzzy set theory and most sequential pattern mining algorithm are used to infer the users’ preference changes in a period. After the test had processed, we use the on-line questionnaire to investigate the customer satisfaction degree from all participators. The results show that the degree of satisfaction was up to 72% for receiving the new information of participants whose preferences had been changed. It indicates that the proposed system can effectively perceive the change of preference for users on a web environment

Billion-Gate Secure Computation with Malicious Adversaries

The goal of this paper is to assess the feasibility of two-party secure computation in the presence of a malicious adversary. Prior work has shown the feasibility of billion-gate circuits in the semi-honest model, but only the 35k-gate AES circuit in the malicious model, in part because security in the malicious model is much harder to achieve. We show that by incorporating the best known techniques and parallelizing almost all steps of the resulting protocol, evaluating billion-gate circuits is feasible in the malicious model. Our results are in the standard model (i.e., no common reference strings or PKIs) and, in contrast to prior work, we do not use the random oracle model which has well-established theoretical shortcomings

Inhibition of NKCC1 Modulates Alveolar Fluid Clearance and Inflammation in Ischemia-Reperfusion Lung Injury via TRAF6-Mediated Pathways

Background: The expression of Na-K-2Cl cotransporter 1 (NKCC1) in the alveolar epithelium is responsible for fluid homeostasis in acute lung injury (ALI). Increasing evidence suggests that NKCC1 is associated with inflammation in ALI. We hypothesized that inhibiting NKCC1 would attenuate ALI after ischemia-reperfusion (IR) by modulating pathways that are mediated by tumor necrosis-associated factor 6 (TRAF6).Methods: IR-ALI was induced by producing 30 min of ischemia followed by 90 min of reperfusion in situ in an isolated and perfused rat lung model. The rats were randomly allotted into four groups comprising two control groups and two IR groups with and without bumetanide. Alveolar fluid clearance (AFC) was measured for each group. Mouse alveolar MLE-12 cells were cultured in control and hypoxia-reoxygenation (HR) conditions with or without bumetanide. Flow cytometry and transwell monolayer permeability assay were carried out for each group.Results: Bumetanide attenuated the activation of p-NKCC1 and lung edema after IR. In the HR model, bumetanide decreased the cellular volume and increased the transwell permeability. In contrast, bumetanide increased the expression of epithelial sodium channel (ENaC) via p38 mitogen-activated protein kinase (p38 MAPK), which attenuated the reduction of AFC after IR. Bumetanide also modulated lung inflammation via nuclear factor-κB (NF-κB). TRAF6, which is upstream of p38 MAPK and NF-κB, was attenuated by bumetanide after IR and HR.Conclusions: Inhibition of NKCC1 by bumetanide reciprocally modulated epithelial p38 MAPK and NF-κB via TRAF6 in IR-ALI. This interaction attenuated the reduction of AFC via upregulating ENaC expression and reduced lung inflammation

ELEMENTARY SCHOOL BOYS’ SOCCER KICK SKILL ANALYSIS

The purpose of this study is aimed to analyze elementary school boys’ kicking skills on the perspective of motor skills. The data is collected by Vicon Motion Analysis System (250Hz). The parameters include the compare of the instant joint angles and the time proportion during the process of the kicking toward the different kick performance groups. The participants are 36 elementary boy soccer players (age: 11.7±0.3 yrs; height: 1.42±0.13 m; weight: 37.5±13.0 kg). The subjects were divided to two groups according to the instance kicking ball speed. The result indicated that the high ball speed group players have greater extremity joint angles than the low ball speed group. No difference was found on the time proportion during the process of the kicking. We suggest that the learning of kicking skill can start with the lower speed in the beginner stage

Reconstruction for Mandibular Implant Failure

Mandibular defects may result from tumor ablations, trauma, or radiation necrosis. Significant segmental mandibular loss or hemimandibular loss may sometimes be replaced with mandibular implants by ENT surgeons/oral surgeons/head and neck surgeons. However, this may bring about mandibular implant failure in long-term follow-up. Mandibular implant failures usually manifest as: soft tissue atrophy, mandibular implant extrusion, infection, facial nerve involvement, facial asymmetry, derangement of occlusion and mastication, orocutaneous fistula, etc. Over 30 years, the authors have treated 102 patients with mandibular implant failure. Reconstruction may involve removal of the mandibular implant and immediate replacement of the mandibular defect with a piece of vascularized bone flap, not only to compensate for bone loss but also to replace neighboring soft tissue and possible skin defects. Frequently used flaps have been vascularized iliac bone (89/102) or vascularized fibula grafts (13/102). During follow-up, iliac bone flap reconstruction has yielded more favorable results due to its ample bone bulk and adequate soft tissue coverage. Fibula flaps with osteotomies have been associated with an increasing incidence of malunion/nonunion and subsequent easy deformation

Discovery of selective inhibitors of Glutaminase-2, which inhibit mTORC1, activate autophagy and inhibit proliferation in cancer cells

Glutaminase, which converts glutamine to glutamate, is involved in Warburg effect in cancer cells. Two human glutaminase genes have been identified, GLS (GLS1) and GLS2. Two alternative transcripts arise from each glutaminase gene: first, the kidney isoform (KGA) and glutaminase C (GAC) for GLS; and, second, the liver isoform (LGA) and glutaminase B (GAB) for GLS2. While GLS1 is considered as a cancer therapeutic target, the potential role of GLS2 in cancer remains unclear. Here, we discovered a series of alkyl benzoquinones that preferentially inhibit glutaminase B isoform (GAB, GLS2) rather than the kidney isoform of glutaminase (KGA, GLS1). We identified amino acid residues in an allosteric binding pocket responsible for the selectivity. Treatment with the alkyl benzoquinones decreased intracellular glutaminase activity and glutamate levels. GLS2 inhibition by either alkyl benzoquinones or GLS2 siRNA reduced carcinoma cell proliferation and anchorage-independent colony formation, and induced autophagy via AMPK mediated mTORC1 inhibition. Our findings demonstrate amino acid sequences for selective inhibition of glutaminase isozymes and validate GLS2 as a potential anti-cancer target

Analgesic and Anti-Inflammatory Activities of the Ethanolic Extract of Artemisia morrisonensis Hayata in Mice

The aim of this study was to investigate the possible analgesic and anti-inflammatory mechanisms of the ethanolic extract of A. morrisonensis Hayata (AM EtOH ). Two models were employed for evaluation of the analgesic effects: acetic acid-induced writhing response and formalin-induced paw licking. The results demonstrated that AM EtOH decreased writhing response for both the acetic acid assay and the licking time in the formalin test. The anti-inflammatory effect was evaluated by paw edema of mice induced by λ-carrageenan. AM EtOH significantly decreased induced paw edema three to four hours after λ-carrageenan injection. Additionally, the results indicated that the anti-inflammatory mechanism of AM EtOH may be due to the declined levels of nitric oxide (NO) and malondialdehyde (MDA) in the edematous paw. Furthermore, AM EtOH decreased the tumor necrosis factor-alpha (TNF-α) and interleukin-6 (IL-6) levels, leading to the reduction of prostaglandins and subsequently alleviated edema. Isolation and purification of the AM EtOH extract determined p-hydroxyacetophenone to be a major component at 130 mg/g of extract. No mortality was observed in the acute toxicity test given at the dose of 10 g/kg. This study demonstrated the possible mechanisms for the analgesic and anti-inflammatory effects of AM EtOH for mice and provided evidence for the ethnobotanical uses of A. morrisonensis in treating inflammatory diseases